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We present a game of interacting agents which mimics the complex dynamics found in many 
natural and social systems. These agents modify their strategies periodically, depending on their 
performances using genetic crossover mechanisms, inspired by biology. We study the performances 
of the agents under different conditions, and how they adapt themselves. In addition the dynamics 
of the game is investigated. 



I. INTRODUCTION 

Is the "survival of the fittest" principle limited to biol- 
ogy only? Perhaps not and there could be other spheres 
of life in which this principle is applicable. Competition 
plays a key role and in order to compete and thus survive 
in any environment or situation, one primarily needs to 
adapt in order to succeed. Then what is adaptation and 
evolution? Adaptation is an alteration or adjustment in 
structure or habits, often hereditary, by which a species 
or individual improves its condition in relationship to its 
environment. Evolution is the change in the genetic com- 
position of a population during successive generations, as 
a result of natural selection acting on the genetic varia- 
tion among individuals, and resulting in the development 
of a new species. Here, we show that in the behaviour 
of various complex systems found in natural and social 
environments Xi 2a ^ <^ that can be characterized 
by the competition among interacting agents for scarce 
resources, adaptation to the environment plays a very 
important role. 

These agents could be diverse in form and in capa- 
bility, ranging for example, from carcinogenic cells in the 
human body to multinational firms in the global financial 
market. In these dynamically evolving complex systems 
the nature of agents and their behaviour differ a lot but 
they have a common underlying mechanism. In order to 
have a deeper understanding of the interactions of the 
large number of agents, one should first consider the in- 
dividual capabilities of the agents. Its behaviour may be 
thought of as a collection of simple rules governing "re- 
sponses" to numerous "stimuli". The rules of action serve 
as the agents' strategies, and the behaviour of an agent is 
the rules acting sequentially. Therefore, in order to model 
any complex dynamically adaptive system, a major con- 
cern is the selection and representation of the stimuli and 
responses, since the behaviour and strategies of the com- 
ponent agents are determined thereby. Then the agent 
needs to adapt to different situations, where the experi- 
ence of an agent guides it to change its structure so that 
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as time passes, the agent learns to make better use of the 
environment for its own benefit. However, the timescales 
over which the agents adapt vary from one individual to 
another and also from one system to another. 

In complex adaptive systems, many interesting tempo- 
ral patterns are produced, since a major part of the en- 
vironment of a particular agent includes other adaptive 
agents and a considerable amount of agent's effort goes 
in adaptation and reaction to the other agents. Thus the 
situation is considerably different and more complicated 
than in game theory @ and conventional theories in eco- 
nomics, where the study is of patterns in behavioural 
equilibrium that induce no further interaction. 

In this paper, we study a sim ple g ame based on the 
basic minority game 0, 0, 0, ^i HTf ^ where the agents 
adapt themselves by modifying their strategies from time 
to time, depending on their current performances, using 
genetic crossover mechanisms [iM ll^ ll4L ll^ . The game 
can be a very simple representation of a complex adap- 
tive system. We make a comparative study of their per- 
formances with the various mechanisms and in a "test" 
situation. 



II. MODEL 

In this section we give a brief description of the model. 
The basic minority game consists of an odd number N of 
agents who can perform at a given time t, any of the two 
possible actions denoted here by or 1. The minority 
game was based on the El Parol bar problem, created by 
Brian Arthur, in which a population of agents have to 
decide whether to go to the bar every Thursday night, 
and so there were two possible actions "to attend" de- 
noted by 1 and "not to attend" denoted by 0, depending 
on whether the bar was too crowded or not Q- An agent 
wins the game if it is one of the members of the minor- 
ity group. All the agents are assumed to have access 
to finite amount of "global" information: a common bit- 
string "memory" of the M most recent outcomes. With 
this there are 2*^ possible "history" bit-strings. Now, a 
"strategy" consists of two possible responses, which in the 
binary sense are an action or action 1 to each possible 
history bit-strings. Thus, there are 2^ possible strate- 
gies constituting the whole "strategy space". 
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Figure 1: Plots of (a) attendance and (b) performance of the 
players for the basic minority game with = 801, M = 6, 
A: = 10 and T = 5000. 



Each time the game has been played, time t is incre- 
mented by unity and one "virtual" point is assigned to 
the strategies that predicted the correct outcome and 
the best strategy is the one which has the highest virtual 
point score. The performance of a player is measured by 
the number of times the player wins, and the strategy, 
which the player uses to win, gets a "real" point. The 
number of agents who have chosen a particular action, 
say 1 which represents "to attend", is denoted by Ai{t) 
(also referred as "attendance") and it varies with time. 
We have plotted the attendance and performance for the 
basic minority game in Fig. ^ 

Now we define the total utility of the system as the 
number of persons in the minority group at a given time 
t. For convenience, we mathematically define a scaled 
utility (total utility /maximum utility) as 



U= [(l-0{xt~XM))xt+O{xt-XM){N-Xt)]/xM, (1) 

where xm — {N — l)/2, xt is either equal to Ai{t) or 
Ao(t), and Q[x) is Heaviside step function: 



when a; < 
when X > Q. 



The players examine their performances after every 
time interval r. If a player finds that he is among the 
fraction n (where < n < 1) who are the worst perform- 
ing players, he adapts himself and modifies his strategies. 
The mechanism by which the player creates new strate- 
gies is genetic crossover, whereby he selects the two "par- 
ents" from his pool of k strategies and creates two new 
"children" as described in Fig. El 

If the parents are chosen randomly from the pool of 
strategies then the mechanism represents a "one-point 
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Figure 2: Schematic diagram to illustrate the mechanism of 
one-point genetic crossover for producing new strategies. The 
strategies Si and Sj are the parents. We choose the breaking 
point randomly and through this one-point genetic crossover, 
the children su and s; are produced. 



genetic crossover" and if the parents are the best strate- 
gies then the mechanism represents a "hybridized genetic 
crossover". The children may replace parents or two 
worst strategies and accordingly four different interest- 
ing cases arise: (a) one-point genetic crossover with par- 
ents "killed", i.e. parents are replaced by the children, 
(b) one-point genetic crossover with parents "saved", i.e. 
the two worst strategies are replaced by the children but 
the parents are retained, (c) hybridized genetic crossover 
with parents "killed" and (d) hybridized genetic crossover 
with parents "saved". 

It should be noted that the mechanism of evolution 
of strategies is considerably different from earlier at- 
tempts [3 0, 01 . This is because in this mechanism 
the strategies are changed by the agents themselves and 
even though the strategy space evolves continuously, its 
size and dimensionality remain the same. 

The Hamming distance du between two bit-strings is 
defined as the ratio of the number of uncommon bits to 
the total length of the bit strings. It is a measure of the 
correlation between two strategies: 
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which can be plotted as the game evolves. 



III. RESULTS 

In order to determine which mechanism is the most 
efficient, we have made a comparative study of the four 
cases, mentioned earlier. We plot the attendance as a 
function of time for the different mechanisms in Fig. 

In Fig. 0we show the total utility of the system in each 
of the cases (a)-(d), where we have plotted results of the 
average over 100 runs and each point in the utility curve 
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Figure 3: Plots of the attendances by choosing parents ran- 
domly (a) and (b), and using the best parents in a player's 
pool (c) and (d). In (a) and (c) case parents are replaced 
by children and in (b) and (d) case children replace the two 
worst strategies. Simulations have been done with = 801, 
M = 6, = 16, t = 40, n = 0.4 and T = 10000. 



represents a time average taken over a bin of length 50 
time-steps. The simulation time is doubled from those 
in Fig. El in order to expose the asymptotic behaviour 
better. On the basis of Figs. El and 0) we find that the 
case (d) is the most efficient. 

In Fig. 13 (a) one can see the evolution of the average 
Hamming distance of all the strategies of a player in a 
game, where the player adapts using one-point genetic 
crossover and the two worst strategies are replaced by 
the children and the parents are also saved. It should be 
noted that the Hamming distance can change only when 
the worst strategies are replaced by the children and the 
parents are saved, where the bits in a strategy pool can 
change over time. Otherwise the bits in the pool of strate- 
gies remain the same. We observe that the curves tend 
to move downwards from around 0.5 towards zero, which 
means that as the time evolves, the correlation amongst 
the strategies increases and the strategies in the pool of a 
particular agent converges towards one strategy. The na- 
ture of the curves depend a lot on the parameters of the 
game. In Fig. [Hl(b) one can see the evolution of the aver- 
age Hamming distance of all the strategies of a player in 
the game, where the player adapts using hybridized ge- 
netic crossover and the two worst strategies are replaced 
by the children and the parents are also saved. Here too, 
the strategies in the pool of a particular agent converges 
towards one strategy, and at a faster rate than with the 
previous mechanism. We observe that increasing memory 
M does not change dramatically the convergence rate, 
but as we increase the number of strategies in the pools, 
the convergence slows down. 

In order to investigate what happens in the level of an 
individual agent, we created a competitive surrounding- 
"test" situation where after T = 3120 time-steps, six play- 
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Figure 4: Plots of the scaled utilities of the four different 
mechanisms in comparison with that of the basic minority 
game. Each curve represents an ensemble average over 100 
runs and each point in a curve is a time average over a bin 
of length 50 time-steps. In the inset, the quantity (1 — U) is 
plotted against scaled time in the double logarithmic scale. 
Simulations are done with N = 801, M = 6, k ^ 16, t ^ 40, 
n = 0.4 and T = 20000. 



ers begin to adapt and modify their strategies such that 
three are using hybridized genetic crossover mechanism 
and the other three one point genetic crossover, where 
children replace the parents. The rest of the players play 
the basic minority game. In this case it turns out that 
in the end the best players are those who use the hy- 
bridized mechanism, second best are those using the one- 
point mechanism, and the bad players those who do not 
adapt at all. In addition it turns out that the competi- 
tion amongst the players who adapt using the hybridized 
genetic crossover mechanism is severe. 



IV. CONCLUSION 

We can summarize our findings by stating that adap- 
tation improves not only the individual player's perfor- 
mance but also improves the total utility of the system. 
The best results are found for the players who adapt 
and modify their strategies using the hybridized genetic 
crossover mechanism and the children replace the two 
worst strategies and the parents are saved. The mech- 
anism of adaptation is very simple and can be used to 
model different complex adaptive systems. It can also be 
potentially developed to include other features Hke mu- 
tation. We can thus say that in a way, "biology helps you 
to win a game". 
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Figure 5: Plot of the average Hamming distance of all 
the strategies in a pool of a player with time, where the 
player adapts using (a) one-point genetic crossover and (b) 
hybridized genetic crossover, and in both cases the two worst 
strategies are replaced by the children and the parents are 
also saved. Each curve is an ensemble average over 20 runs. 
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Figure 6: Plot of the performance of the players where after 
T = 3120 time-steps, six players begin to adapt and mod- 
ify their strategies: three using hybridized genetic crossover 
mechanism and the other three using one point genetic 
crossover, where children replace the parents. Other players 
play the basic minority game all the time and do not adapt. 
The simulations are done with A'^ — 801, M = 8, fe = 16, 
n = 0.3, t = 80, and T = 10000. 
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